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Abstract 



This paper initiates the study of quantum computing within the constraints of using a polylog- 
arithmic (0(log fc n), k > 1) number of qubits and a polylogarithmic number of computation steps. 
The current research in the literature has focussed on using a polynomial number of qubits. A new 
mathematical model of computation called Quantum Neural Networks ( QNNs) is defined, building 
on Deutsch's model of quantum computational network. The model introduces a nonlinear and 
irreversible gate, similar to the speculative operator defined by Abrams and Lloyd. The precise 
dynamics of this operator are defined and while giving examples in which nonlinear Schrodinger's 
equations are applied, we speculate on its possible implementation. The many practical problems 
associated with the current model of quantum computing are alleviated in the new model. It is 
shown that QNNs of logarithmic size and constant depth have the same computational power as 
threshold circuits, which are used for modeling neural networks. QNNs of polylogarithmic size 
and polylogarithmic depth can solve the problems in NC, the class of problems with theoretically 
fast parallel solutions. Thus, the new model may indeed provide an approach for building scalable 
parallel computers. 

Key Words: theoretical computer science; parallel computation; quantum computing; Church- 
Turing thesis; threshold circuits. 



1 Introduction 

The concept of quantum computing, based on the quantum mechanical nature of physical reality, 
is first stated by Benioff [3] and Feynman ^S], and formalized by Deutsch ^3], Bernstein and 
Vazirani 8 , and Yao [121 • For background material, the reader is referred to the papers mentioned 
above, survey papers [21 [§1 ESI EE] , books QUE], and courses available on the web [291 130] . 

Considerable interest has been generated in quantum computing since Shor [HZ] showed that 
numbers can be factored in polynomial time on a quantum computer. From a practical viewpoint, 
Shor's result shows that a working quantum computer can violate the security of transactions 
that use the RSA protocol, a standard for secure transactions on the Internet. From a theoretical 
viewpoint, the result seemingly violates the polynomial version of the Church- Turing thesis; it 
is generally believed that factoring cannot be done in polynomial time on a deterministic or 
probabilistic Turing machine. What makes Shor's breakthrough result possible on a quantum 
Turing machine is that exponentially many computations can be performed in parallel in one step 
and certain quantum steps enable one to extract the desired information. 

Even though simple quantum computers have been built, enormous practical issues remain 
for larger-scale machines. The problems seem to be exacerbated with more qubits and more com- 
putation steps. In this paper, we initiate the study of quantum computing within the constraints 
of using a polylogarithmic (0(log k n), k > 1) number of qubits and a polylogarithmic number of 
computation steps. The current research in the literature has focussed on using a polynomial 
number of qubits. (Recently, researchers have initiated the study of quantum computing using a 
polynomial number of qubits and a polylogarithmic number of steps (2E1I2I1E1E3) We define a 
new mathematical model of computation called Quantum Neural Networks (QNNs), building on 
Deutsch's model of quantum computational network |14j . The new model introduces a nonlinear, 
irreversible, and dissipative operator, called D gate, similar to the speculative operator introduced 
by Abrams and Lloyd We also define the precise dynamics of this operator and while giving 
examples in which nonlinear Schrodinger's equations are applied, we speculate on the possible 
implementation of the D gate. 

Within a general framework of size, depth, and precision complexity, we study the compu- 
tational power of QNNs. We show that QNNs of logarithmic size and constant depth have the 
same computational power as threshold circuits, which are used for modeling neural networks. 
QNNs of polylogarithmic size and polylogarithmic depth can solve the problems in NC, the class 
of problems that have theoretically fast parallel solutions. Thus, the new model subsumes the 
computation power of various theoretical models of parallel computation. 

We believe that the true advantage of quantum computation lies in overcoming the commu- 
nication bottleneck that has plagued the implementation of various theoretical models of parallel 
computation. For example, NC circuits elegantly capture the class of problems that can be theo- 
retically solved fast in parallel using simple gates. While fast implementations of individual gates 
have been achieved with semiconductors and millions of gates have been put on a single chip, we 
do not have the implementation of full NC circuits because of the communication and synchro- 
nization costs involved in wiring a polynomial number of gates. We believe that this hurdle can 
be overcome using the nonlocal interactions present in quantum systems — there is no need to 
explicitly wire the entangled units and the synchronization is instantaneous. This advantage is 
manifest in the standard unitary operator, where operations on one qubit can affect probability 
amplitudes on all the qubits, without requiring explicit physical connections and a global clock. 
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Local unitary operator Source gates Sink gate 
Figure 1: Components of Deutsch's quantum computational network model 



Thus, the new model has the potential to overcome the practical problems associated with both 
quantum computing as well as classical parallel computing. 

The paper addresses three categories of researchers: complexity theory, neural networks, and 
quantum computing. For complexity theorists, the paper shows that the 2 log ° (1>n bounds on 
threshold circuits obtained in various results such as [Hj is not necessarily infeasible. (Polynomial 
time and space is generally accepted as defining feasible bounds.) For neural network researchers, 
the paper mathematically proves that threshold circuits used for modeling neural networks have 
the same computation power as the equality threshold circuits, introduced in this paper. The new 
class has certain algebraic advantages and it may indeed be beneficial to redo the theory of neural 
networks under this model. Finally, for quantum computing researchers, the paper shows that 
with quantum computing we can build scalable parallel computers, beyond the current digital 
technology, under very tight constraints. Of course, this depends on the physical realization 
of the inherently nonlinear gate introduced in the paper and thus it is worthwhile exploring its 
implementation. Furthermore, we do not need to limit ourselves to the fundamental linear models 
of systems to obtain useful devices; we should explore systems at a different level of abstractions 
that may not be defined by linear equations. 

This paper is organized as follows: Section |2] summarizes the current model of quantum 
computing, together with the associated problems, including some new issues not discussed in the 
literature. Section |3] first defines a framework for new quantum computing models, based on the 
problems discussed in Section |2J The D gate is introduced within this framework. (This is the 
only speculative part of the paper; that is, we do not know how to implement the D gate.) QNNs 
are defined to be Deutsch's quantum computational network |14| together with the D gate. 

Section |1] quantifies the computational power of the new model. We prove that equality 
threshold circuits have essentially the same computational power as the standard class of threshold 
circuits used for modeling neural networks. Then QNNs are shown to have the same computational 
power as equality threshold gates. Section |S] defines the precise dynamics of the D gate. Section 
El identifies some of the many nonlinearities in quantum systems. Finally, Section delineates 
many interesting research directions suggested by this paper. 



2 Current Model of Quantum Computing 

There are two equivalent models for quantum computing, quantum Turing machines |13l l8] based 
on reversible Turing machines [HI El and quantum computational network . Our model builds 
on the latter, so we briefly review it here. The basic unit in quantum computation is a qubit, 
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a superposition of two independent states |0) and |1), denoted «o|0) + where ao,«i are 

complex numbers such that |ao| 2 + |«i| 2 = 1- A system with n qubits is described using 2 n 
independent states \i),0 < i < 2 n — 1, each associated with probability amplitude «£, a complex 
number, as follows: Ylf=o 1 where X]i=o 1 \ ai \ 2 = 1- ^ ne direction of a{ on the complex plane 
is called the phase of state \i) and the absolute value |otj| is called the amplitude of state 

The computation unit in Deutsch's model consists of quantum gates whose inputs and outputs 
are qubits. A gate can perform any local unitary operation on the inputs. It has been shown that 
one-qubit gates together with two-qubit controlled NOT gates are universal (I]. 

The quantum gates are interconnected by wires. A quantum computational network is a 
computing machine consisting of quantum gates with synchronized steps. By convention, the 
computation proceeds from left to right. The outputs of some of the gates are connected to the 
inputs of others. Some of the inputs are used as the input to the network. Other inputs are 
connected to source gates for and 1 qubits. Some of the outputs are connected to sink gates, 
where the arriving qubits are discarded. The essential ingredients of the model are summarized 
in Figure H An output qubit can be measured along state |0) or |1), and is observed based on 
the probability amplitudes associated with the qubit. 

Even though simple quantum computers have been built, enormous practical issues remain 
for larger-scale machines. Landauer [2B] exposes three main problems: decoherence, localization, 
and manufacturing defects. Decoherence is the process by which a quantum system decays to a 
classical state through interaction with the environment. In the best case, coherence is maintained 
for some 10 4 seconds, and, in the worst case, for about 10~ 10 seconds for single qubits. Some 
decoherence models show the coherence time declining exponentially as the number of qubits 
increases |39j . Furthermore, the physical media that allow fast operations are also the ones with 
short coherence times. 

The computation may also suffer from localization, that is, from reflection of the computational 
trajectory, causing the computation to turn around. Landauer 23 points out that this problem 
is largely ignored by the research community. The combination of decoherence and localization 
makes the physical realization of quantum computation particularly difficult. On the one hand, 
we need to isolate a quantum computing system from the environment to avoid decoherence, and 
on the other hand, we need to control it externally to compel it to run forward to avoid reflection. 
Finally, minor manufacturing defects can engender major errors in the computations. 

Introduction of the techniques of error-correcting codes and fault-tolerant computation to 
quantum computation has generated considerable optimism for building quantum computers, 
because these techniques can alleviate the problems of decoherence and manufacturing defects. 
Though this line of research is elegant and exciting, the codes correct only local errors. For 
example, one qubit can be encoded into the nonlocal interactions among three qubits to correct 
one qubit errors. However, in principle, any (nonlocal) unitary operator can be applied to all the 
qubits. These nonlocal errors easily subvert the error-correcting codes. Also, nonlocal interactions 
provide the exponential speed-ups in quantum computing. The hope that nature might allow 
computational speed-ups via nonlocal interactions, while errors are constrained to occur only 
locally, seems unavailing. For an excellent exposition on error-correcting codes and fault-tolerant 
quantum computing, the reader is referred to |3()j . 

It has been shown that one-qubit gates together with two-qubit controlled NOT gates are 
universal |3|; that is, any 2™ x 2 n unitary operator can be decomposed into a polynomial number 
of one and two qubit operators. However, in general, any error operator can be applied in one 
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step that cannot even be detected without observing all the involved qubits. Having the ability to 
operate on many qubits does not solve the problem, for error-correcting codes for k qubit errors 
can be subverted by a (k + l)-qubit error operator. Eventually, construction of a 2™ x 2 n operator 
will itself be more time consuming than the actual computation. 

There are some additional difficulties with computing using a polynomial number of qubits for 
a polynomial number of steps that are not discussed in the literature. For example, if n = 1000 
and an 0(n 2 ) quantum algorithm is used, we need one million uniquely identifiable but identical 
carriers of quantum information. Clearly, the carriers need to be uniquely identifiable because we 
are not using their statistical properties, but encoding 2°( n ) computations in their interactions. 
However, the carriers need to be absolutely identical for the following reason. In describing the 
Hamiltonian for the whole system, there is a phase oscillation associated with each carrier. If all 
carriers have the same frequency, it does not affect the computation, which essentially changes 
the state relative to the global oscillation. But each qubit is likely to be encoded in carriers with a 
much larger state space, and even slight frequency differences can result in substantial errors over 
a polynomial number of steps. The task of preparing one million absolutely identical carriers, 
while exploiting the 2 10 interactions, most of which are nonlocal, for speeding-up computation 
appears insurmountable. 

In conclusion, controlling a polynomial number of entangled qubits for a polynomial number 
of steps, while compelling the computation forward, seems hard even with the help of error- 
correcting codes. To address the above problems, we initiate the study of quantum computation 
under the constraints of a polylogarithmic number of qubits and a polylogarithmic number of 
steps. 

3 Quantum Neural Networks (QNNs) 

In the previous section we saw that the problems with the current model get worse as the number 
of qubits and computation steps increase. Therefore, we make the following premises for a new 
model. 

• The computation should be achieved within a few (0(log fc n), k > 1) steps. 

• (Optional) The computation should use only a few (0(log fe n), k > 1) qubits. 

• There should be irreversible synchronization points in the computation to avoid the problem 
of localization. 

The second point is optional because a single particle, in principle, can encode an infinite 
amount of discrete information, for example, in spins —s/2, —(s — l)/2, . . . , s/2 for any number s. 
Thus, many qubits can be encoded within a single particle, and hence, it may be worthwhile ex- 
ploring models that use many qubits encoded on a few carriers. However, in this paper we observe 
all the above premises. Note that within the framework of our premises, quantum computation 
does not seem to violate the polynomial version of the Church- Turing thesis. 

The next question is what operations should we have besides the standard unitary operator. 
In particular, what irreversible, and hence, nonlinear operators can be exploited for computation. 
In its present formulation, quantum mechanics for an isolated system, or one interacting with 
classical external potentials, is linear in the state vector. However, if full interactions with an 
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environment are taken into account, then their effects can be found by projecting the larger state 
vector of the combined system into the subspace of our system alone. As a result, the evolution 
equation for the latter state vector is not necessarily linear. The behavior of a system can also be 
nonlinear because of the interactions between the degrees of freedom, as discussed in Section El 

In general, these nonlinear operations can be on the phases as well as amplitudes (or both) 
associated with a quantum system. The phases in a quantum system have the following properties. 

• Phases cannot be directly observed. 

• They have an oscillation associated with them. 

• Quantum mechanics can be defined using a density matrix formulation, which is typically 
used when incorporating phase information is not feasible. 

Therefore, it seems natural to have nonlinearities on amplitudes only. Specifically, we introduce 
a new nonlinear operator D gate (for dissipative) in Deutsch's quantum computational network 
model |14j . The operator D(m,5), abbreviated D with threshold 5 (Figure^, when applied to 
the m qubits in a system with n > m qubits behaves as follows. Let the states of m qubits 
be represented by binary numbers through 2 m — 1 or, equivalently, binary strings m through 
l m . Let A(\j)) and A'(\j)) respectively denote the probability amplitudes before and after the 
application of the D operator. Then, 

|-4(|0 m ))| <5^A'(\0 m )) = 0, 

and 

|„4(|0 m ))| > 5^A'(\0 m )) = c. 

The value c for probability amplitude denotes some constant used for encoding 1. For example, 
if a system consists of n qubits, then A'(\0 m )) = l/v / 2™ is sufficient for the case |*4(|0 m ))| > 5. 
In this case, threshold 5 is chosen so that < 5 < l/\/2™- (From now on, we'll simply use 1 
instead of c.) Note that the behavior of the D gate is undefined on all the states except |0 m ). In 
this paper, it is irrelevant what happens to these states as the corresponding qubits go to a sink 
gate after the application of the D operator. Also, the behavior of the D gate at |^4(|0 m ))| = 5 is 
irrelevant in this paper. 

If the m qubits passed through the D gate are part of a larger quantum system with n > m 
qubits, then the D operator behaves as above for all amplitudes A(\j; m )), where j, < j < 2 n ~ m . 
Thus, amplitudes of different states \j;0 m ) converge to or 1 depending on the initial value of 
A(\j; m )), independently of each other. 

In practice, only an approximate behavior of D may be realizable within finite convergence 
time (Figure EJ). This can be sufficient, depending on the circuit which uses the gate. We will see 
that 5q, 6, and 5± are defined by the types of problems we are trying to solve. 

The D gate can be intuitively thought of as a contractive operator that evolves general states 
towards a single (stable) state |0 m ). Clearly, it cannot be realized in an isolated system where 
the only permissible operators are unitary. However, as discussed before, a truly isolated system 
is, in any case, a theoretical ideal which is difficult to realize in practice. In Section |SJ we see 
that the D gate needs inherently nonlinear behavior as well as dissipative behavior. It is similar 
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to the speculative operator defined by Abrams and Lloyd pQ; however, the nonlinearity depends 
only on the amplitude and not on phases. 

To meet the requirement of having at most a polylogarithmic number of qubits, we use a 
dense encoding of n classical bits, labelled xq, ■ ■ ■ ,x n -\, in only O(logre) qubits. There are 
several alternatives. The following simple one suffices. Assume n is a power of 2. Interpret the 
states of logn qubits as addresses and if the jth classical bit is 1, then -4(|j)) = 1, else A{\j)) = 0. 
As before, the value 1 represents some appropriate constant c; if the system has logn qubits, 
c = l/\/n is sufficient. We include a special sink state z so that the probabilities add to 1. Thus, 
l-4(l z ))| 2 = 1 — Sj=o l-^(b'))! 2 - The s i n k state may be composed of several states. For example, 
if we think of the sink state as an additional qubit, then A(\j; 0)) can be used for encoding and 

i, and \A(\j; i))| 2 = i - E"=o l-4(li;0))| 2 - 

As in Deutsch's quantum computational network model [Tl|, our model has quantum gates 
interconnected by wires. In particular, we preserve source "d sink gatefl Our model also 
has the standard reversible unitary operator U. Since we are working within the constraints of 
polylogarithmic qubits, we allow arbitrary unitary operator^. Of course, a unitary operator of 
dimension 2 log n ,k > 1, can be approximated by decomposition into log fc n,k > 1, local operators 
using standard techniques [3]. However, in principle, any unitary matrix is allowed in quantum 
mechanics. We say that a U gate has precision p if all the values in the matrix can be approximated 
to within 1/2 P+1 by binary rational numbers. 

The unitary operator implicitly contains the important properties that overcome the main 
problems with classical parallel computing: communication bottleneck and synchronization over- 
head. Because of entanglement, operations on even one qubit can affect all the qubits instanta- 
neously, without the need for explicitly wiring them together. While the research in literature has 

1 When a qubit goes to a sink gate, it is measured to remove the entanglements with the remaining qubits. 
2 With polynomial number of qubits, if we allow arbitrary unitary operators (of size 2™ x 2" ), then the cost of 
constructing the apparatus can defeat the gains in computational speed. 
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Figure 3: QNN for NAND(xi, x 2 ) 



focussed on exploiting the exponential properties of quantum systems to perform computations 
infeasible with the current digital systems, our model is using only the entanglement and interfer- 
ence present in quantum systems to overcome the communication bottleneck and synchronization 
problems that have plagued the implementation of parallel computers. We believe that scalable 
parallel computers can be built using quantum systems. 

A quantum neural network QNN(s(n), d(n)) of precision p(n) is a circuit of size s(n) and depth 
d(n), constructed from the gates D and U of precision p(n). Size denotes the number of qubits in 
the circuit and depth denotes the longest sequence of gates from input to output. In general, the 
reversible U gate is followed by the irreversible D gate to eliminate the problem of localization. 
Usually, the precision of the circuits will be 0(s(n)). 

Size, depth, and precision are important complexity-theoretic measures that quantify various 
aspects of computations. Depth corresponds to the number of steps needed to solve a given prob- 
lem. Size usually corresponds to the size of apparatus; precision also characterizes the apparatus 
needed for solving the problem. 

3.1 Examples of QNNs 

We give examples of QNNs for some simple circuits with the universal NAND gates. Define a 
unitary matrix U nanc i that operates on two qubits as follows. 
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In the input vector A, is encoded as and 1 is encoded as 1/2. The amplitude of the state 
1 00) in the state vector U nanc [X is if and only if NAND(xi,X2) = 0. Thus, when we pass the 
qubits through a D(2,5) gate with < 5 < l/2\/6, the amplitude of state 1 00) has the correct 
answer (Figure |3J). We have not included the sink state in the above description. 

Next we show how a circuit with three NAND gates can be simulated by a QNN (see Figure 

Define U2 to be the following unitary matrix. 
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Figure 4: QNN for a circuit with NAND gates 



The operator U2 operates on X T = l/\/8[xi, 1, X2, 1, X3, 1, X4, 1]. When the result is passed 
through the Z>x(l,<5i) gate, < 5i < • 8, we simulate the two NAND gates simultaneously. 

The resulting vector is [NAND(xi, X2), 1, NAND(x3, X4), 1], which is used to simulate the last 
NAND gate as before. As an aside, the construction of QNNs for arbitrary circuits of NAND 
gates, given in Section^ is different from the construction given in Figure0]and has worse bounds. 

4 Computational Power of QNNs 

In this section we characterize the computational power of QNNs using the known results from 
the complexity theory of parallel computations and threshold circuits (used for modeling neural 
networks |25| I26|). First, we define a class of circuits called EC and show that with polynomial 
size they have the same computational power as threshold circuits. EC circuits can be converted 
into QNNs using a proper encoding of classical bits into qubits. 

4.1 Circuits 

Let G be a set of gates (functions) that map several bits to one bit. For each n > 0, a circuit C n 
over the set G is a directed, acyclic graph with a list of input nodes (with no incoming edges), 
a list of output nodes (with no outgoing edges), and a gate in G labeling each non- input node. 
Given a binary input string (x\, . . . ,x n ), we label each input node X{ or x~i (NOT xi). For every 
other node v with m predecessors y\, . . . , y m , we recursively assign a value g(yi, ■ ■ ■ , y m ), where 
g is the gate that labels node v. C n outputs the value given by the list of output nodes. 

Unless otherwise stated, in this paper, we shall allow the circuits to have arbitrary fan-in and 
fan-out. Circuits with fan-out 1 will be called "opened circuits," where the corresponding graph 
is a tree. The size of a circuit C n is the number of nodes in C n and the depth of C n is the length 
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of the longest path from any input node to an output node. 

A circuit family is an infinite list of circuits C = (Ci, C2, ■ ■ ■ , C n , . . . ) where C n has n binary 
inputs. C computes a family of boolean functions (/1, /2, • • • , fn, ■ ■ ■), where f n is the boolean 
function computed by circuit C n . We say that C has size complexity s(n) and depth complexity 
d(n) if for all n > circuit C n has size at most s(n) and depth at most d(n). Size and depth are 
important complexity descriptions of circuits that respectively characterize the size of apparatus 
and the number of steps needed to compute a family of boolean functions. 

A circuit family is polytime-uniform if there exists a Turing machine with time bound n k ,k > 1, 
that constructs circuit C n on input l n . A circuit family is logspace-uniform if there exists a Turing 
machine with space bound logn that constructs circuit C n on input l n . Uniformity conditions 
capture the complexity of constructing the circuit to compute boolean functions with inputs of a 
given size. 



4.2 Threshold Circuits 

A threshold function with threshold A is a boolean function denoted Th nA : {0, l} n -> {0, 1} 
such that 

"p-** A 

'10 otherwise 

for xi, . . . ,x n £ {0, 1}, where < A < n. A weighted threshold function of weight bound w and 
threshold A is a boolean function denoted IVi™^ Wn : {0, l} n — > {0, 1} such that 



Th n ' A (xi 



otherwise 



for wi, . . . , io n , A£Z (set of integers), \wi\ < w for all i, and xi, ... , x n £ {0, 1}. 

A threshold circuit is a circuit over the set of threshold gates. Let TC(s(n),d(n)) denote the 
collection of threshold circuits of size s(n) and depth d{n). We overload the notation TC to also 
denote the class of functions computable by these circuits. Weighted TC(s(n), d(n)) of weight 
bound w denotes the collection of threshold circuits using weighted threshold gates of weight 
bound w of size s(n) and depth d(n). 

Theorem 4.1 [32] Suppose an analytic function f(x) has a convergent Taylor series expansion 
f( x ) = Y^=o c n{x — xo) n over an interval \x — xq\ < e where < e < 1, and the coefficients 
are rationals c n = a n /b n where a n ,b n are integers of magnitude at most 2 n ° (1> . Then polytime- 
uniform threshold circuits of polynomial size and simultaneous constant depth can compute f(x) 
over this interval within accuracy 2~ nC for any constant c > 1. 

The above theorem implies that TC(n°( 1 ), O(l)) can approximate elementary functions such as 
sine, cosine, exponential, logarithm, and square root. TC(n°^ 1 \ O(l)) can also exactly compute 
integer and polynomial quotient and remainder, interpolation of rational polynomials, banded 
matrix inverse, and triangular Toeplitz matrix inverse |32j . 
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4.3 Equality (Threshold) Circuits 



A (weighted) equality threshold function of weight bound uu > is a boolean function denoted 
EtZ u ..., Wn : {0,1}" -+{0,1} such that 

Ff n C Tl _ x _ / if £?=1 WiXi = 

M Wl ,...,w n {Xl,--- ,Xn)-<^ 1 otherwige 

for w\, . . . ,w n G Z, \wi\ < io for all i, and x\, . . . ,x n £ {0, 1}. Note that Et gates possess an 
elegant algebraic structure as they can be naturally generalized to any domain, such as complex 
numbers. 

An equality threshold circuit of weight bound w is a circuit over the set of equality threshold 
gates such that all the weights are absolutely bounded by w. Let EC(s(n), d(n)) denote the 
collection of equality circuits of size s(n) and depth d(n). EC will also be used to denote the class 
of functions computable by these circuits. 

We will see that the weights of a EC circuit can be encoded appropriately in unitary matrices, 
and quantum entanglement and interference can be used to compute YZj=i w j x j m one step. 
Thus, EC provides a good model to help combine ideas from quantum computing and threshold 
circuits. 

4.4 AND-OR Circuits 

NC is the collection of logspace-uniform circuits of size and depth (logre) ^ 1 ) over the set 

{AND, OR} of gates with fan-in bounded by 2. It is the class of problems that can theoretically 
be solved efficiently in parallel and contains numerous natural problems. We write NC to denote 
both the class of circuits and functions computable by the circuits. NC*,i > 1, denotes the 
subclass of NC where the depth is limited to 0(log*n). Though NC circuits use remarkably 
fast AND, OR gates, the implementations of circuits have not been successful because of the 
communication bottleneck and synchronization cost involved in wiring a polynomial number of 
processors. The algorithms that show that problems are in NC are typically not used to solve 
problems in parallel; new algorithms are designed depending on the parallel architecture model 
that takes communication cost into account. 

NC 1 is known to have several natural problems such as integer arithmetic and matrix mul- 
tiplication. NC 2 includes matrix inverses and matrix rank computation as well. Please see any 
standard text such as and [3^ f° r more details. 

4.5 Computational power of TC and EC circuits 

We now show that TC and EC circuits have essentially the same computational power if we 
consider circuits of polynomial size. In all our constructions, if the original circuits are polytime- 
uniform and logspace-uniform, the constructed circuits are also polytime-uniform and logspace- 
uniform, respectively. 

Lemma 4.2 

,x n ) can be simulated by EC(0(n),2) of weight bound 0(n). 
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Figure 5: Simulation of Threshold gate Th nA by EC of weight bound 0(n) 




Figure 6: Simulation of TC with EC 



2. TC{s{n),d(n)) C EC(s 3 (n),d(n) + 1) of weight bound 0{s 2 {n)), and TC(s(n), d(n)) C 
EC(0(s 2 (n)),2(i(n)) of weight bound 0{s{n)). 

Proof. 

1. Figure El shows the EC circuit that simulates the threshold gate Th n '^(xi, X2, ■ ■ ■ ,x n ). 
Note that the gates at level 2 check whether Y17=i x i ^ s one °f the va l ues 0, 1, . . . , A — 1, 
respectively. 

Case Q27=i x i < ^) : Exactly one gate at level 2 outputs and all others output 1 giving 
the cumulative output of A — 1, which when combined with the input — A + 1 at level 
1 gives the output of 0. 

Case Q27=i x i — ^11 t ne gates at level 2 output 1 giving the cumulative output of A, 
which when added to the — A + 1 input at level 1 gives the final output of 1. 
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Thus, the cumulative output of gates at level 2 is A and A — 1 if the threshold gate outputs 
1 and 0, respectively. The level 1 gate is used to add the outputs of gates at level 2 and 
subtract A — 1 from this sum. 

The weight bound of the constructed circuit is | — A + 1| = 0(n). 

2. An obvious replacement of each threshold gate by the circuit of Figure gives a depth of 
2d{n) and size 0(s 2 (n)). We can reduce this bound to d(n) + 1. Consider a threshold gate 
Th m 2 A2 connec ted to another threshold gate Th miAl . Fi gure El shows how the threshold 
gate at level 2 can be replaced by the equality threshold gates at level 2 described in Figure 
El Since the cumulative output of these equality threshold gates is A2 and A2 — 1 instead 
of 1 and 0, we simply increase the threshold of the level 1 gate of Figure El by A2 — 1. It is 
easy to see that this replacement does not affect the function computed by the circuit. 

The construction is as follows. Starting at the input level of TC circuit, replace each 
threshold gate as described above and adjust the threshold at the next level appropriately. 
Repeat the process for all levels. At the output level, use both level 1 and 2 gates of Figure 
El so that the final gate is also a Et gate. As shown in Figure El connect the new gates to 
all the gates connected by the replaced threshold gate. 

Since the maximum threshold for all the threshold gates is bounded by s 2 (n) and each 
threshold gate is replaced by A Et gates, the final circuit has 0(s 3 (n)) Et gates. The 
weight bound for the circuit is 0(s 2 (n)) because at the output level, the thresholds of all 
the s(n) threshold gates are added together. 

□ 



Lemma 4.3 

1. Et^ _ Wn (xi, . . . ,x n ) can be simulated by weighted TC(3, 2) of weight bound 
max(|u;i|, . . . , \w n \). 

2. EC(s(n), d(n)) of weight bound w C Weighted TC(2s(n) + o, d(n) + 1) of weight bound w, 
where o is the number of output nodes in the EC(s(n), d(n)) circuit. 

Proof. 

1. Figure 13 shows the TC(3,2) circuit that simulates the gate Et^ w [x\,... ,x n ). The 
leftmost gate at level 2 outputs 1 if Ya=1 w i x i ^ 1 an d the rightmost gate outputs 1 if 
Y17=i w i x -i — — 1- The gate at level 1 adds the two outputs from level 1 gates and outputs 
if and only if Yli=i w i x i = 0- 

2. An obvious replacement using Figure gives a circuit of depth 2d(n). We can reduce this 
bound to d(n) + 1. Consider an equality threshold gate Et™ 2 connected to another equality 
threshold gate Et mi . Figure El shows how the equality threshold gate at level 2 can be 
replaced by the equality threshold gates at level 2 described in Figured 

The construction is as follows. Starting at the input level of EC circuit, replace each Et 
gate with the level 2 threshold gates given in Figured Repeat the process until the output 
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Figure 8: Simulation of EC with TC 
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Figure 9: Making weights positive by complementing input 



level. At the output level, use both level 1 and 2 gates of Figure so that the final gate is 
also a Th gate. As shown in Figure El connect the new gates to all the gates connected by 
the replaced threshold gate. 

Each Et gate is replaced by two Th gates except at the output level where each Et gate is 
replaced by 3 Th gates. 

Since we do not change the absolute value of the weights, therefore the weight bound of the 
new circuit is the same as that of the original circuit. 



Lemma 4.4 

Weighted TC(s(n),d(n)) of weight bound w C TC{0{w ■ s(n)),d(n)). 
Proof. 

1. Suppose a threshold gate A is connected to another gate B with an edge with weight 
wab > 0. Simply make wab copies of gate A and connect them to gate B using an edge of 
weight 1. In general, we need at most w ■ s(n) copies. 

Edges of weight can be removed from the circuit. If a particular edge weight is negative, 
we can make it positive using the following standard technique. 

Repeat the following steps for all gates at all levels starting from the output level down to 
the input level. 

(a) If any weight Wi < is negative, replace the weight with — W{ > and the corresponding 
input Xi with 1 — x% as shown in Figure ED Decrease the threshold of the gate by w\ . 
Thus, YliLi w i x i > A if and only if —w\(l — X\) + Y^iLs w % x % > A — ioj.. 

With this step, some gates at intermediate levels may have two labels Xj and 1 — x%. 
If this is the case, duplicate the gate labelling one Xi and the other 1 — X{ retaining all 
the input connections. In the worst case, we double the number of gates. 

(b) To complement the output of a gate from y to 1 — y, use the process shown in Figure 
1101 Replace all the weights Wi with —Wi and change the threshold to 1 — A. Thus, the 
gate outputs 1 — y if and only if YliLi w i x i < A if and only if — YliLi w % x % > — A if 
and only if YHL\{~ w i) x i > 1 — A. 
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Figure 10: Complementing output by negating weights 



When the input level is reached, change X{ to Xi and vice versa as needed. The above process 
does not change the weight bound of the circuit. 

□ 

Lemma 4.5 

1. NAND(a?i, X?) can be simulated by Et\ 1 _ 2 ( x i; x 2> 1)- 

2. For all i > 1, N& C EC(n°W, 0(log l n)) of weight bound 2. 

3. f^ffi SPACE(s(n)) C AND-OR circuits of size 2 s ( n ' ) and depth s 2 (n) via s 2 (n) -uniform space- 
bounded Turing machines. 

Proof. 

1. Follows immediately from the definitions. 

2. Since NAND gate is a universal gate, it can be used in place of AND and OR gates for NC 
circuits. Then, use the Et\ i _ 2 ( x i> x 2, 1) gate to simulate NAND gates. 

□ 

We are now ready to characterize the computational power of QNNs. Recall that the precision 
denotes the number of bits used for characterizing the amplitudes. Thus, if an amplitude is defined 
with precision p, then the actual value may differ by 1/2P+ 1 , that is, the errors must be less than 

Theorem 4.6 EC(s(n), d(n)) of weight bound w C QNN(0(<i(n) log s(n)), 2d(n)) of precision 
0(log w + d{n) log s{n)). 

Proof. For the sake of clarity, we write s and d instead of s{n) and d(n), respectively. Assume 
that all the gates have s = 2 m inputs each; add inputs with weight 0, if necessary. Without loss of 
generality, we may assume that the circuits have one output. (Otherwise, connect all the output 
gates to another threshold gate and remove the corresponding layer in the constructed QNN.) 
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Level I gates 



Level {l-l) 



Qml+1- 




u 



2(i-l)m+l x 2(i-l)"»+l 



Figure 11: QNN for level I of EC circuit 



Given an unbounded fan-in, unbounded fan-out EC(s, d) circuit of weight w, starting from 
the output gate "open" the circuit by duplicating gates of fan-out greater than 1 to obtain a new 
circuit. Add dummy gates to obtain a levelled circuit EC(0(2 md ), d). 

Given this structured circuit, we will replace all the EC gates at level I by a U operator of size 
2im+l x 2'wi+l followed by a Dim + 1,6) operator (Figure fTT^ . where the threshold 5 is specified 
below. Thus, we need a system with md + 1 = 0(d log s) qubits qo, q\ , . . . , q m d, q m d+i ■ After each 
D(m + 1, 5) operator, m qubits (except go) go to a sink gate so that we have only one qubit left 
after d levels of alternating U and D gates. Then this qubit is observed along state |0) to obtain 
the final answer. 

For each level / of the EC circuit do the following. 

1. Normalize the weights Wjk, 1 < k < s, at each gate j by dividing them by \/J2k=i l^jfcl 2 - 
Since weights are bounded by w, therefore \/Ylk=i \ w jk\ 2 — y/sw and we require at least 
0(logs + logw) precision for the weights. (To avoid the accumulation of errors as the 
computation proceeds through different levels, we will need slightly higher precision.) 

2. Construct a banded matrix U of size 2 lm+1 x 2 lm+1 and band width 2 m+1 . For each gate 
j, 1 < j < 2 m<yl ~ l \ with normalized weights Wji,wj2 • • • , Wj s , we have a block Bj in U. 

The first row of Bj corresponds to the weights of gate j and the remaining rows are chosen 
so that the rows of Bj form a set of orthonormal vectors. The U matrix is the banded ma- 
trix with diagonal blocks B\, . . . , B 2 (i-i)m- Note that the first row of block Bj computes the 
weighted sum Ylk=i w jk%jk for the jth gate if the input is X T = [xji, 0, Xj2 , 0, • • • , Xj2 m , 0] , 1 < 
j <; 2 m ( 1 - 1 ) . if we pass the m + 1 = log s + 1 least significant qubits through a D(m + 1, 5) 
gate, we simulate all the Et gates at one level in parallel. 
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Wj2^ 
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Once the circuit is constructed as above, the computation is performed as follows. 

Computation: The input at level I is a state vector of size 2 ml+1 x 1 as follows: X T = 
[xji, 0, Xj2, 0, ■ • • ,Xj2 m ,0],l < j < 2 m ( l ~ 1 \ where Xjk, 1 < k < 2 m , are inputs to the jth gate. 
The operation f/X computes the the weighted sum of all the gates at level I. Pass the m + 1 
least significant qubits through a D(m + 1,5) gate followed by the sink gate for m qubits (except 
go), where 5 is chosen to be sufficiently small. (The exact value is specified below and depends 
on error bounds.) Note that this process simulates all the Et gates at one level in parallel, where 
U gate computes the weighted sum and the D gate acts as a zero checker. 

Precision of amplitudes in the state vector x: At the lowest level of the circuit we have 2 md 
input nodes such that z2i=i \ x i\ = 1- Thus, we need a precision of at least 0\dm) = Oydlogs) 
for the state vector. Of course, after every D gate, l/2 m of these states disappear. Therefore, if 
the amplitudes are not lost in the sink state, we need a precision of O(Zlogs) at level I. 



Precision of weights in U gates: Let e; > denote the error bound in weight values at level 
I, where the output node corresponds to level 1. As mentioned before, we need to ensure that 
e; < -4— at all levels I. Let w\,W2,. ■ ■ ,w s be the correct normalized weights corresponding to 
a row of U. Let w^w^, ■ ■ ■ ,w' s be the erroneous weights. Let Xj and x'p 1 < j < s, respectively 
denote the correct and the erroneous input values corresponding to the row of U. Then, 



ei < 



WjXj 



s 

< J2(\ w j\ + e i+i)(\ x j\ +e«+i) -^2\wj\\xj 



3=1 



3=1 



< sef +1 + e l+l ^{\wj\ + \xj\) 

3=1 

< sef +1 + 2e m v^, as ^=1 \ w j\ 2 = 1 and £j=i \ x j\ 2 < 1 

< (v^+i) 2 + 2 v / sQ+i 

If ei < 3 i s }/2 w i t nen we have t\ < for all /. Thus, the circuit needs 0(1 logs + logw) precision 
for the weights in U gate at level I. 



Threshold and Precision for the D gate: The smallest integral value that can put the 
corresponding Et gate over the threshold is 1. The corresponding weights in QNN are normalized 
by dividing by y/Ylk=i \ w jk\ 2 < v 7 ^- ^ so the normalized input of l's are encoded as y / l/2 ml = 
l/v 7 ?. Therefore, we can choose < 5 < l/\fs^\fsw, a good value being 5 = l/2V / ?y / izi). With 
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error bound e we can ensure that the amplitude values never fall in the range (So, 5±), where 5o = e 
and 5± = 28 — e. 

The output of D gate must be within q of the correct value at level I. □ 

Corollary 4.7 TC(n°W,0(l)) C QNN(0(logn), O(l)) 0/ precision O (log n). 

Thus, QNN(0(log n), 0(1)) can approximate elementary functions such as sine, cosine, expo- 
nential, logarithm, and square root. It can also exactly compute integer and polynomial quo- 
tient and remainder, interpolation of rational polynomials, banded matrix inverse, and triangular 
Toeplitz matrix inverse. 

Corollary 4.8 NC 1 C QNN(0(log 2 n), 0(log n)) of precision O (log 2 n). 

Corollary 4.9 NC 2 C QNN(0(log 2 n), 0(log 2 n)) of precision 0(log n). 

Thus, QNN(0(log 2 n), 0(log 2 n)) can compute various matrix operations such as inverse and 
rank. 

Corollary 4.10 NC C QNN(log° (1) n, log° (1) n) of precision log° (1) n. 

Corollary 4.11 POLYLOGSPACE C QNN(log°W n, log°W n) of precision log° (1 K. 

Hence, the several natural problems in TC and NC can be solved using only log * 1 ) n qubits 
and at most log°^ n steps. 

So far the D gate was not completely defined. However, to delimit the power of QNNs, 
we need to define the behavior completely. For the following results, we assume that only the 
least significant qubit out of the D gate is not connected to the sink gate and A(\j; 1)) = for 
all j. These assumptions ensure that the D gate is not performing difficult computations on the 
undefined states. The result holds if the behavior of the D gate on all the states \i), 1 < i < 2 m — 1, 
is the same as that on the state |0 m ). 

Theorem 4.12 QNN(s,d) of precision p C EC([d/2]2 s , \d/2]) of weight 0(2 2 ^ s +pI). (Read 
s(n) and d(n) for s and d, respectively.) 

Proof. Replace every U gate that has k qubits as input with 2 k weighted linear adders and 
every D gate with a zero checker. Consecutive linear adders can be combined into one adder, and 
an adder followed by the zero checker can be combined into a Et gate. Thus, the depth of the 
EC circuit is reduced by at least half. 

Since the original circuit has s qubits and depth d, we need at most 2 s equality threshold gates 
at each level for a total of at most \d/2]2 s gates. (Multiple U gates at the same level operating 
on different qubits need less than 2 s gates.) 

In general, the weights in the U matrix can be complex numbers while Et gates are allowed 
to have only integer weights. Thus, we need to ensure that both the real and imaginary parts are 
zero. This can be done simultaneously by scaling the imaginary part of weights by 2 2 r io s s +Pl and 
the real weights by 2^ logs+p T and then adding them to obtain a single integer. Scaling by 2 2 ^ logs T 
ensures that the weighted sums of the real and imaginary parts do not mix. □ 

Thus, the computational power of simplified QNN(0(logn), 0(1)) of precision O(logn) is the 
same as that of EC(n°W, 0(1)) of weight bound n°W and TC(n W, O(l)). 
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4.6 Encoders and Decoders 

In the previous section, we proved that QNNs can process information in parallel if the information 
is presented in encoded form. However, in general, the information may be available only in the 
classical form. In this case, a special apparatus needs to be built to encode n classical bits 
into O(logn) qubits. In this section, we show that such an apparatus is indeed feasible by 
demonstrating unitary matrices for encoders. These unitary matrices are highly structured, and 
hence, in practice their implementations may look quite different from the way it is presented 
here. 

Encoders: Recall that we need to encode n = 2 m classical bits aj, < i < n — 1, in logn qubits 
as cY^iZo a i\i)^ where cti = ai, cii G {0, 1}, and c is an appropriate constant such as 1/ ' \fn. 

The unitary operator for the encoders operates on n qubits each in one of the states |0) or |1), 
log n qubits to be used for encoding, and an additional qubit corresponding to the environment or 
sink. The operator can be described as 2 n+logn+1 x 2 n+lo s ri+1 banded matrix of band size 2n x 2n. 
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All the entries ejk of i?f,„_ 1 ;, n _ 2 ...b are chosen so that the rows form a system of orthonormal 
vectors. Now suppose we want to encode n classical bits ao,ai,... , a n -i hito logn qubits as 
described above. Prepare a system in the following state |ao,ai, • • • , a-n-i', logri ; 0), where logn 
denotes the state of qubits used for encoding and the last qubit corresponds to the sink state. 
After the operator Ue is applied to this state, we obtain the following superposition of states: 
c Y^i=o a «l a 0) a ii ■ ■ ■ )G n _i;z;z), where «j = a, if z = 0, and ai = 1 — ctj if z = 1. Now send the 
first n qubits corresponding to the classical bits to sink gates to obtain the encoding in the log n 
qubits as needed. 



Decoders: If the output consists of one classical bit, a simple observation of the corresponding 
qubit will yield the classical information. Even if there are more than 1 bit in the output, they can 
be observed after repeated runs of the circuit, or by having multiple copies of the circuit. Having 
multiple copies of the circuit has the advantage of making the computational system robust. 
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5 Dissipation Gate 



In this section, we show that the behavior of the D gate can be modeled by cubic nonlinear 
differential equation. Similar equations are frequently used in quantum systems of interacting 
particles. Though these equations are not identical to ours, we believe that they demonstrate the 
consistency of D gate with the laws of quantum mechanics and identify some possible approaches 
for implementing it. Another significant aspect of the D gate is irreversibility. To achieve this 
dissipative property in a quantum system, it is necessary to introduce some kind of controlled 
interaction with, say, an environment Designing specific mechanisms, though possible in 

principle, will not be facile. 



5.1 Amplitude evolution equation 

We show that the dynamical behavior of the D gate on the amplitude of state |0 m ) can be achieved 
by cubic nonlinearities using stable points and 1. Since it is irrelevant what happens to states 
other than |0 m ), for simplicity, let us denote .A(|0 m )) by A. (Indeed, the amplitudes of all the 
states can evolve as follows without affecting our results.) The differential equation that describes 
the required behavior is 



-A = RA(\A\-6)(1-\A\) , (1) 

where R denotes the rate of convergence. It is clear that the phase of A remains invariant under 
this evolution and only its amplitude is a dynamical variable. So, let us focus on a = \A\. Note 
that T£ is negative in the range (0,6) and positive in the range (6,1). Thus, a monotonically 
decreases in the range (0,6) and monotonically increases in the range (6, 1). Also, the derivative 
% is at points 0,6, 1, and therefore, a does not change at these points. 

Let oo denote the initial value of a. Then the explicit solution to Equation Q is 

(±\ 1/s (^±Y mi - s> (iz£\ 1/,1 - < * = e -« (2) 

\a J \a -6J \l-a J 

Alternative forms, convenient for analyzing the behavior near the points 0,6, 1, may be obtained 
by raising both sides to the appropriate power. For example, near 0, we may write 



:) 



e~ SRt (3) 



\a J \a - 6 J \1- 
for convenience. 

If ao 7^ 6 and t — > oo, the right side of the equation tends to 0. Since a monotonically decreases 
in the range (0, 6) and monotonically increases in the range (6, 1), it converges to or 1 as t —* oo, 
depending on whether it started below or above 6, respectively. 



5.2 Convergence time 

Suppose the system is set up so that amplitudes never fall in the range (6q,6\), where < 6q < 
6 < 6\ < 1. The specific values 6o and 6\ depend on the properties of quantum neural network 
(QNN) which, in turn, depends on the problems we are trying to solve. 
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The next question is what should be the rate of convergence, R, so that the fixed points and 
1 are reached with tolerance e within some finite time T. Demanding both 



we obtain two equations by substituting a = e, s = 5q and a = 1 — e, s = 6\ in Equation (j2J. The 
two equations provide two rates Ro and R\, for a < 5q and a > Si, respectively. For our purposes, 
it is sufficient to choose R = max(i?o ; Ri) so that both inequalities (|4l5j) are satisfied. Thus, given 
5q,5i, 6, e and time T, we obtain the parameters of the system needed to implement the D gate. 

The evolution described so far converges |.A(|0 m ))| to or 1 without changing the phase of 
the state. In the next step we collapse .A(|0 m )) to or 1. 

5.3 Dissipation 

Once the amplitude |^4(|0 m ))| converges close to or 1, the quantum system is measured along 
state |0 m ). The measurement collapses the system to state |0 m ) with a high probability if 
|^4(|0 m ))| 2 is close to 1. Note that this part of the D operator is also dissipative and irreversible. 
We envisage interactions of our quantum system with an environment, in a controlled fashion, 
can produce both the nonlinearities and the collapse needed to construct the D gate. 

What happens if the system is observed along state |0 m ) and |^4(|0 m ))| 2 = ? This situation 
occurs when say a photon in state | — ►) is observed using an orthogonal filter | j) — nothing is 
observed. This difficulty is easily addressed while solving another problem described below. 

In general, the m qubits passed through the D gate are part of a larger computing system 
of m < n qubits. In this case, we demand the above nonlinear behavior of the D gate on all 
|j;0 m ) states, for < j < 2 n ~ m — 1. This general behavior presents the following difficulty. It is 

possible that Y,fS^~ l \A(\j; m ))| 2 < Ejlo"^ 1 Efe=i \Ai\j\ k ))\ 2 ' and hence, when the system is 
measured along state |0 m ), it does not collapse to state |0 m ) as needed. 

To solve the above problem, we introduce an ancilla qubit z in state |0) so that A(\j; k; 1)) = 
for < j < 2 n ~ m — 1 and < k < 2 m — 1. Once the amplitudes A(\j; m ; 0)) have converged close 
to or 1, transfer the amplitude of state \ j; O" 1 ' 1 !; 0) to state \ j; m ; 1) for all < j < 2 n ~ m - 1. 
This operation on the last of the m qubits and the qubit z is performed using the following 4x4 
unitary operator. 



The operator U changes the state for the last qubit and the ancilla qubit from [£>o,0, ^2 5 0] 
to [bo,b2,0, 0] so that when the last qubit is measured along |0), it collapses to state |0) as 
A^j;^' 1 !-^)) = for all < j < 2 n ~ m - 1 and < z < 1. Of course, the above unitary 
behavior and interaction with an environment can be built in the D gate without requiring a 
separate operator. 

If we need to collapse all the m qubits to the state |0 m ), the above process can be executed 
for all the m qubits. However, to solve the many problems described in this paper, we do not 



a(T) < e if a(0) < S 
1 - a(T) < e if a(0) > S x 
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need to do so. All except the last of the m qubits are discarded to solve these problems. Thus, it 
is irrelevant what happens to the other m — 1 qubits when we observe them. 

Next we describe some simple quantum systems that can be modeled using cubic nonlinearities. 
While the equations for these systems are different from Equation Q , they demonstrate that cubic 
nonlinearities are common in modeling quantum systems and indicate some possible approaches 
for implementing the D gate. Furthermore, these models clearly demonstrate that we have not 
tapped the full power of quantum systems available to us. 



6 Nonlinearities in Quantum Mechanical Systems 

In this section, we address the question of nonlinearities in quantum mechanics. While it is 
generally believed that, at the fundamental level, the evolution of the entire universe is governed by 
a linear Schrodinger's equation for "the wavefunction of the universe," this view is not particularly 
helpful in practice. For limited physical systems, such as those found in our laboratories, the linear 
Schrodinger's equation is only an approximation where certain degrees of freedom can be ignored 
or controlled. Thus, in the most celebrated example, an electron in a hydrogen atom, we find [HE] 



ill 



^(x,t) 
dt 



V 2 

2m r 



^(x,t), (6) 



where 2irh is the Planck's constant, ip(x,t) is the wave function (probability amplitude) associated 
with the electron at space-time point (x, t), m is the electron mass, e the elementary charge, and 
r is the magnitude |x|. Here, the nucleus (proton) has been placed at the origin of the coordinate 
system, providing only an "external," Coulomb potential (e 2 /r) in which the electron moves. All 
the degrees of freedom associated with the proton are ignored in this equation. In fact, it is treated 
as a classical particle. Had we taken into account its quantum mechanical properties, or the fact 
that it is composed of three quarks, we would have to consider wave functions for these and to 
deal with the associated equations. The resultant would be far more complex than equation ©. 
Similarly, the Coulomb potential is known to be one aspect of a photon, so that its degree of 
freedom has also been ignored in this simple equation. If the quantum mechanics of the photon is 
also taken into account, we are necessarily faced with the full theory of relativistic quantum fields 
|21j . The most venerable example of such kind of system is quantum electrodynamics |21| I16j , 
in which interactions between the electrons and photons are fully incorporated. Nevertheless, 
by ignoring all degrees of freedom except that associated with the electronic position, a simple 
linear equation such as © has been used to predict many properties of the hydrogen atom, to 
a high degree of accuracy. Parenthetically, notice that the spin degree of freedom, a favorite in 
quantum computing community, is also ignored in equation Q. When this is included into a 
more complex version of equation ©, the effects of "spin-orbit" coupling can be discussed and a 
better approximation of the properties of hydrogen emerges. 

Between the simplest levels of approximation, such as equation Q, and the most com- 
plete/complex theories lies a vast set of approaches. Instead of simply ignoring some of the 
other degrees of freedom, these "intermediate" theories incorporate some of their effects into "ef- 
fective interactions." The results involve, typically, nonlinear equations. We give two examples 
here. 
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An early example, predating quantum electrodynamics, takes into account the "self interac- 
tion" of the electron in, say, the hydrogen atom. The idea is that, since quantum mechanical 
description of the electron is in terms of a probability distribution, P(x) = |?^(x)| 2 (where we 
have dropped the t dependence for simplicity), we are faced with a charge distribution associated 
with this electron: p(x) = — eP(x), i.e., 

p(x) = -e|V>(x)| 2 . (7) 

By the known laws of electrodynamics [20], this charged cloud would generate an electric potential, 
at every point in space, x, of the form 

But then this potential should affect the electron in a way no different than the potential due to 
the proton (that is, the e 2 /r term in Equation ©)• Inserting this extra potential into ©, we 
have 
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Combining Equations (|7J8( and El) we arrive at a Schrodinger's equation with cubic nonlinearity: 
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(10) 



Notice that the last term describes the electron's interaction with itself, as the source of the po- 
tential is the electronic cloud. We should emphasize that this equation was eventually abandoned 
for a number of reasons. One of them is that, as an approximation which keeps only the electronic 
degree of freedom (ip) while ignoring the photonic degree of freedom, it is too crude to describe 
self interaction adequately. As mentioned above, quantum electrodynamics was developed and 
the final picture is not simply embodied in equation (|TU|) . 

Another example, which is similar in form, comes from the study of structure of atoms with 
more than one electron. Instead of self interactions, the interest here is the mutual interactions 
between the electrons. Known as the Hartree approximation, with the photonic degrees of freedom 
still ignored, a system of nonlinear Schrodinger equations are used, even today (see Schiff [35] . 
Section 47): 



.. d , 

ih— tpk (x fc ,t) 
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Here, ^fc( x fc) t) is the wave function of the k th electron in an atom with Z electrons (and Z protons 
in the nucleus) and = |xj — x^| is the distance between it and the j th electron. Notice that 



this is a system of Z nonlinear integrodifferential equations for the Z unknowns ip^ (x^ , t) . 
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Both of these examples illustrate the use of nonlinear Schrodinger equations (up to cubic 
terms) in the context of quantum mechanical systems. Very similar equations are also used in 
the context of nonlinear optics. In fact, many of these are even closer in form to the ones we 
proposed, for example, 

|U(t) = Cl A + c 3 \A\ 2 A, (12) 

where c\ and C3 are constants (|lt)|. page 280). Similarly, nonlinear Schrodinger equations of 
this type appear frequently in the study of solitons ^Hj- Finally, known as the time dependent 
Landau-Ginzburg equation, nonlinear systems of the form of (|12|) are ubiquitous in many areas 
of condensed matter physics. 

In elementary quantum mechanics, the equations of evolution tend to be linear in the wave 
function, describing various degrees of freedom (such as spins) subjected to external potentials. 
However, as soon as internal interactions between the degrees of freedom we wish to describe are 
incorporated, nonlinearities are inevitable. This section serves to illustrate that evolution of many 
physical systems are governed by nonlinear equations. Since the equations governing the D gate 
are sufficiently similar to many of those in physical systems, we believe that its implementation 
should be possible. 

7 Research Directions 

This paper initiates research into what problems can be solved using only polylogarithmic (log ^ n) 
entangled qubits and at most polylogarithmic steps. All the efforts so far have concentrated on 
what can be achieved using a polynomial number of qubits. We have shown that constant depth 
QNNs of logarithmic size have the same computational power as threshold circuits of polynomial 
size and constant depth, which are used for modeling neural networks. QNNs possess several 
advantages over threshold circuits. First, we need only O(logn) qubits. Second, there is no com- 
munication bottleneck and synchronization problems associated with computing the weighted 
sum in a threshold gate; there is no need to explicitly wire the entangled qubits together and 
the synchronization is instantaneous for the computation of the weighted sum. Finally, quantum 
systems have the ability to compute on probability distributions rather than just discrete values, 
giving them the ability to handle fuzzy sets |43j . 

The research suggests several interesting directions. 

1. Define a continuous version of QNNs using probability amplitude distributions. Quan- 
tum mechanics uses infinite-dimensional Hilbert spaces to model reality. (Even a simple 
system such as an electron around a nucleus in a hydrogen atom is modeled using infinite- 
dimensional Hilbert space.) How can this be used to generalize the discrete model discussed 
in this paper? What kind of gates/operators are allowed? Just as we used discrete values 
to encode boolean values, we can use the continuous distribution to encode membership in 
fuzzy sets 

2. How can error-correcting codes and fault-tolerant computing be adapted to the new model, 
both for the discrete and continuous versions? 

3. Following the road map provided by the theory of neural networks, define a theory of 
QNN(log° (1) n,log° (1) n). What is the equivalent of back -propagation and various other 
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supervised and unsupervised learning algorithms? What is the equivalent of the Hopfield 
model and recurrent neural networks? How can we define the formal statistical mechanics 
of QNNs? 

4. Matrix operations provide the "killer application" for the new model. Improve the bounds on 
our results: TC° C QNN(0(log n), 0(1)) and NC C QNN(log° (1) n, log° (1) n). In particu- 
lar, minimizing the depth of the circuits can provide real-time solutions to several important 
matrix problems. Reducing the depth of the circuits to a constant, even at the expense of 
increasing the size, can provide real-time solutions to problems in POLYLOGSPACE. The 
results in this paper do not take advantage of either complex probability amplitudes as 
weights, or arbitrary unitary operators. (This paper uses banded unitary matrices with real 
weights to perform simulations.) Also, can we get better bounds under various uniformity 
constraints? 

Of course, with polylogarithmic size and precision, the quantum system has more than 
a polynomial number of states, and hence, it may be infeasible to set-up the required 
apparatus in reasonable time. Thus, such computational systems may be more appropriate 
in the context of learning systems, where the parameters are incrementally modified based 
on how the actual output of the system differs from the required output. 

5. Understand the physics behind the implementation of the new operators. What other 
operators are allowed for the discrete as well as the continuous model of QNNs? How can 
they be physically realized? For example, we can define "generalized D gates" that behave 
on all the states 1 < i < 2 m — 1, as the D gate behaves on the state |O m ) using similar 
evolutionary equation. 

6. Develop a theory of EC circuits. While threshold circuits have been studied extensively and 
the computational power of EC circuits is essentially the same as the power of threshold 
circuits (with polynomial size) , it is not at all clear that the learning strategies are essentially 
the same. First, EC circuits can be naturally defined over the domain of complex numbers. 
We need to explore how this larger domain helps. Second, when translated to QNNs, EC 
circuits must have normalized weights, which means that the learning algorithms such as 
back-propagation that make local changes to weights, cannot be directly translated without 
some form of global strategy. Third, for every gate in an EC circuit, QNNs have weight 
vectors orthogonal to the original one. In this paper, these vectors simply dissipate after the 
D operator and sink gates. However, they may indeed be helpful in obtaining better learning 
algorithms. Thus, investigating EC circuits with normalized complex weights and orthogonal 
weight vectors is important, independent of their connection to quantum computing. 

7. Compare QNNs with the existing data in neuroscience to improve our understanding of 
biological neurons and, if necessary, to refine our model. It is well-known that all creatures 
with nervous systems have essentially the same basic processing unit, the biological neuron, 
though different types of neurons have been identified possessing the same general structure. 
The dendrites on the cell body receive inputs from several neurons, the signal is processed 
in the cell body and a long axon, and is output on the other side. Reaction time of the lower 
brain for many non-trivial tasks is less than 100 milliseconds, while the synapse response 
time of most neurons is at least 5 milliseconds. Thus, biological evidence suggests that the 
depth of these circuits cannot exceed 20. 
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It is well-known that the synaptic connections change as the brain learns. However, there 
is almost no experimental evidence of a neuron changing from an excitatory to inhibitory 
or vice versa as the learning occurs. In fact, this is one of the factors cited against artifi- 
cial neural networks (threshold circuits) and the associated learning algorithms where the 
weights associated with synaptic connections can change from positive to negative. 

Thus, it is possible that the unitary operator U is associated with the synapses while the 
dissipation operator D is associated with the cell and the axon. Hence, the synapses are not 
computing on classical bits associated with the input but the quantum interactions between 
the neurotransmitters received at the input. Note that the reality is more complicated 
than this simplistic model. It has been observed that the neurons fire a series of spikes 
and information may be encoded in the rate and timing of firing as well [21]. Of course, if 
we allow feedback in QNNs, the timing issues must be considered. The possibility of the 
information being encoded in the interactions of these carriers needs to be be investigated. 

Acknowledgements: The author is indebted to Harald Hempel for carefully reading the first 
draft of the paper and suggesting numerous improvements. 
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